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: • METHOD AND SYSTEM FOR USING C v 

; PATCliESIN)E;LECTRONICFILMPR(^ ^ 



5 TECHNICAL FIELD 

This invention relates generally to electronic film processing, and more particularly to 
a method and system for using calibration patches jn electronic film processing. 

BACKGROUND OF THE INVENTION 

Conventional color photographic film generally contains three superimposed color 
10 sensing layers. Each layer contains a light sensitive material, typically silver halide, that is 
spectrally sensitive to a specific portion of the visible light spectrum. In general, the top layer 
responds primarily to light of short wavelength (blue light), the middle layer responds 
primarily to light of medium w^avelength (green light) and the bottom layer responds to light 
of long u^avelength (red light). When film with these types of spectral sensitivities is exposed 
15 to visible light, each spot on the film records the intensity of blue, green and red light incident 
on that location of the film. This film record of incident light referred to as the latent image. 

In conventional color photographic development systems, the exposed film is 
chemically processed to produce color dyes in the three layers with color densities directly 
proportional to the blue, green and red light intensities recorded as the latent image. 

20 Conventional chemical film processing involves the application of a number of processing 
solutions to the film to produce the color dyes. A developer solution is first applied to the 
exposed film. In a chemical reaction, the developer solution interacts with the silver halide 
and couplers in the film to produce elemental silver particles and a respective color dye. The 
developmciit process is halted at the proper exposure by rinsing the developer solution off the 

25 film ortfstop solution to the film. A fixing solution is then applied to the film to convert the 
unexposed silver halide to elemental silver. A bleaching solution is then applied to the film 
to rinse away the elemental silver and leave the color dyes in each layer. Additional 
processing solutions can be applied to the film as required to preserve the film. The film is 
then dried and forms a conventional film negative. Through a conventional printing process, 

30 the film negative can be used to produce positive prints of the film negative. The film 
negative can also be electronically scanned to produce a digital image. 
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/ Image enhancement has been the subject of a large body of film processing . : 1 
technology. In particular, color correction is a specific area of image enhancement thiat is i ^^v^ 
particularly problematic. One difficulty with color correction is tr>'ing to correct colors that 
are incorrect without changing the true colors of the pictured scene. 



SUMMARY OF THE INVENTION 

Briefiy summarized, the present invention provides a method for using a calibration 
patch to electronically process exposed film. In one application, the film is exposed to a 
calibration light source that creates a reference patch. Developer solution is then applied to 

10 the film. The film is then electronically scanned without removing the developer solution to 
produce an electronic image and an electronic reference image. The electronic reference 
image is then used to calculate processing parameters for the electronic image. In a particular 
application, the electronic scanning process comprises electronically scanning the silver metal 
particles in the film. In another application, the electronic scanning process comprises 

15 electronically scanning the dyes in the fihn. In yet another application, the electronic 
scanning process comprises a combination of the above. 

In another application of the present invention, a method for using a calibration patch 
in a electronic film processing system is provided. In this application, an unexposed area of 
the film is exposed to a calibration signal to create a reference patch. The film is then 

20 developed to form scene images composed of silver metal particles. Signals corresponding to 
digital representations of scans of the scene image and the reference patch are generated. 
Image processing parameters fi-om the signals associated with the reference patch are 
calculated and used in processing the signals of the digital representations corresponding to 
the scenelmage. The image processing parameters then produce initial color values which 

25 moreratcurately reflect the original scene and which are pleasing to the eye. 

The invention also provides an improved scanning device used to process a developed 
scene image on a film according to the present invention. The scanning device comprises a 
number of optic sensors, an electromagnetic energy source and computer processor. The 
optic sensors generate digital representations of the scene image and a reference patch image. 

30 The computer processor uses the digital representations to calculate image processing 
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> parameters based on the reference patch to produce improved color values for the digital ■ 
representations of the scene image. * ''.-'} 
The various features and characteristics of the present invention wiir become more 
apparent when taken in conjunction with the drawings and the following description wherein. 
5 like referenced numerals represent like parts. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a perspective view of a scanning device in accordance with the present 
invention; 

10 FIG. 2 is an illustration of a duplex film processing system in accordance with the 

present invention; and 

FIG. 3 is a plan view of film containing scene images and reference patches according 
to the present invention. 



15 DETAILED DESCRIPTION 

The method of the present invention involves exposing undeveloped film to a 
calibration light source to produce a reference patch. A developer solution is applied to the 
film to develop the film. The film is electronically scanned without removing the developer 
solution. In one embodiment, as described herein, the film is electronically scanned using a 

20 duplex scanning method whereby the elemental silver in the film is scanned. Duplex 
scanning generally utilizes two electromagnetic radiation sources, with one positioned in 
fi-ont and one in back of the film. The radiation from these sources is attenuated by the 
amount of silver metal particles at each spot on the film. The attenuated radiation is detected 
and convened to digital signals using appropriate optical and electronic systems. Based on 

25 the amount of delected radiation, one embodiment of the present invention produces four 
values, referred to as firont, back» front-through and back-through data, for each pixel on the 
film. These signals are directly related to the silver metal particles that form the scene image. 

An improved digital film scanning apparatus 100, which includes a calibration 
exposure device 107 is shown in Fig. 1. The digital film scanning apparatus 100 may in turn 
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: , ; b._p* of a Urge, optical and elecifnic: sys«„. Th. scanning appamms 100 opSales 
.conv«t,„g.lectromag„e.icradM^^ 

.he ,n,asc. The image being banned is .ypically embodied in a physic.ribna suchWoh I^^Ss^* 

photographic media, i... film. am,ough «her media ™ay, be W: The eiec,™^^^^ 
. radiadon used ,0 convex U,e image into a digitized ,epr^ema.i„n is infrared iighl; however' ? 
v,s,ble „gh, „ic™„avc and other suitable types of electromagnetic radiation may also be 
used to produce the digitized image. 

One embodiment of a duplex scanning apparatus 100. as illustrated in Fig 1 is used 
.0 Illustrate the present invention and its operation. I. will be undetstood that other'suitable 

.0 embodtments of scanning apparatus 100 may be employed without depaning f„m the scope 
of the present invention. For exantple, another embodiment, the scanmng apparatus 100 
opet^tes to scan .be film O-rough 0,e developer using visible Ugh. » de.ec. color dyes in Ute 
film. In anoaer embodimen., the scanning apparatus 100 utilizes a combinalion of visible 
■«ht detection of the color dyes and duplex imaging, as described in detail below, to measute 

15 the metallic Silver particles in the film. 

Tl,escam,i„gappa,a.usl00gene,allyincludesanumberofop.icse„so,sl02 Inthe 
embodiment illusb^ed. the optic sensors 102 measure the intensity of electromagnetic energy 
passmg through and/or reflected by the film 1,2. T^e soutce of electtomagnetic energy is 
.ypieally a light source 1 10 which illuminates the film 1 ,2 containing the scene image ,04 
and *e reference patch image ,08 to be scanned. Radiation 6om the source , 10 may be 
chffused or directed by additional optics such as filtets ,„„t shown, and one or more lenses 
m j^stttoned near the sensors 102 and the film 1,4 in order to iHuminate the images ,04 
-d ,08 more unifonniy. Furthermore, more Utan one source may be used. Source 1 10 is 
postboned o^ the side of the film 1 ,2 opposite the opUc sense,. ,02. This placement tesults 

2^d.O onthefiln,,,. AnoU,erradia.onsource,,,issHownp,^^„,.,,_l 

of.^f n.l, asthesensorslOZ Whenso.ce,llisactiva.ed.se„sot.,02de.ec.r^^^^^^^^ 
~ by «,e .mages 104 and ,08. This ptoccss of using two sources posifioned on 
pos,te stdes of the fihn being scanned is descdbed in more det^l below in conjunction wiu. 
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. The optic sensors 102 ;£^^^^ in an^ys s;u0KJt^ :^3fS 

electromaijnetic en^irgy: striking ?02 corresponds taadistih^^ 

in the images 104 and 108 ■ Accordingly, each distinct location 114 in the scene iiri^ge:!^^ ^ ^ 
corresponds to a distinct localipn, referred to as a picture element, or ^'pixeP' for shprti iii the ; ; ? 
scanned, or digitized image 105. The iihages 104 and 108 on film 1 12 are usually 
sequentially moved, or scanned, across ihc optical sensor array 102. The optical sciisbrs 102 
are typically housed in a circuit package 1 16 which is electrically connected, such as by cable 
118, to supporting electronics for computer data storage and processing, shown together as 
computer 120. Computer 120 can then process the digitized image 105. Alternatively, 
computer 1 20 can be replaced with a microprocessor and cable 1 1 8 replaced with an electrical 
circuit connection. 



Optical sensors 102 may be manufactured from different materials and by different 
processes to detect electromagnetic radiation in varying parts and bandwidths of the 
electromagnetic spectrum. The optical sensor 102 comprises a photodetector (not expressly 
15 shown) that produces an electrical signal proportional to the intensity of electromagnetic 
energy striking the photodetector. Accordingly, the photodetector measures the intensity of 
electromagnetic radiation attenuated by the images 104 and 108 on film 1 12. 

Turning now to Fig. 2, a conventional color film 220 is depicted. As previously 
described, one embodiment of the present invention uses duplex film scanning which refers to 

20 using a front source 216 and a back source 218 to scan a film 220 with reflected radiation 222 
fi-om the front 226 and reflected radiation 224 from the back 228 of the film 220 and by 
transmitted radiation 230 and 240 that passes through all layers of the film 220: While the 
sources 216, 218 may emit polychromatic light, i.e., multi-frequency light, the sources 216, 
218 are generally monochromatic and preferably infrared. The respective scans, referred to 

25 herein as front, back, front-through and back-through, are further described below. 

In Fig. 2, separate color levels are viewable within the film 220 during development 
of the red layer 242, green layer 244 and blue layer 246. Over a clear film base 232 are three 
layers 242, 244, 246 sensitive separately to red, green and blue light, respectively. These 
layers are not physically the colors; rather, they are sensitive to these colors. In conventional 
30 color film development, the blue sensitive layer 246 would eventually develop a yellow dye, 
the green sensitive layer 244 a magenta dye, and the red sensitive layer 242 a cyan dye. 
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During developmcrit, layers 242, 244, and 246 are opalescent. Darklsilver grains 234 : V 

: : developing- in- the; top layc^^ 

film, and slightly visible from the back 228 because of the bulk ofj the p^al^^^^^^ 
Similarly, grains 236 in the bottom layer 242, the red sensitive layer, are .visible from the 

5 back 228 by reflected radiation 224, but are much less visible from the front 226. Grains 238 
in the middle layer 244, the green sensitive layer, arc only slightly visible to refiected 
radiation 222, 224 from the front 226 or the back 228. However, they are visible along with 
those in the other layers by transmitted radiation 230 and 240. By sensing radiation reflected 
from the front 226 and the back 228 as well as radiation transmitted through the film 220 

10 from both the front 226 and back 228 of the film, each pixel for the film 220 yields four 
measured values, one from each scan, that may be mathematically processed in a variety of 
ways to produce the initial three colors, red, green and blue, closest to the original scene. 

The front signal records the radiation 222 reflected from the illumination source 216 
in front of the film 220. The set of front signals for an image is called the front channel. The 
15 front channel principally, but not entirely, records the attenuation in the radiation from the 
source 216 due to the silver metal particles 234 in the top-most layer 246, which is the blue 
recording layer. There is also some attenuation of the front channel due to silver metal 
particles 236, 238 in the red and green layers 242, 244. 

The back signal records the radiation 224 reflected from the illumination source 218 
20 in back of the film 220. The set of back signals for an image is called the back channel. The 
back channel principally, but not entirely, records the attenuation in the radiiation from the 
source 218 due to the silver metal particles 236 in the bottom-most layer 242, which is the red 
recording layer. Additionally, there is some attenuation of the back channel due to silver 
metal particles 234, 238 in the blue and green layers 246, 244. 

25 ^ • The front-through signal records the radiation 230 that is transmitted through the film 

220 from the illumination source 218 in back of the film 220. The set of front-through 
signals for an image is called the front-through channel. Likewise, the back-through signal 
records the radiation 240 that is transmitted through the film 220 from the source 216 in front 
of the fihn 220. The set of back-through signals for an image is called the back-through 

30 channel. Both through channels record essentially the same image information since they 
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both record ihc aii^^^^ of Ihc radiation 230, 240 due to the silver metal pahicies 234, 236^ i ; 
238 in all threjq^ bluef recording layers 242, 244. 246^of thd filrn 220. . ' ; • # 

Sevelral image processing steps arc required to convert the iljuminatipii source, 
radiation information for each channel to the red, green, and blue values similar to those 
5 produced by conventional scanners for each spot on the film 220. These steps are required 
because the silver metal particles 234, 236, 238 that form during the development process are 
not speclrally unique in each of the film layers 242, 244, 246. These image processing steps 
are not performed when conventional scanners are used because the dyes which are formed 
with conventional chemical color processing of the film make each film layer spectrally 
10 unique. However, just as with conventional scanners, once initial red, green and blue values 
are derived for each image, further processing of the red, green, and blue values is usually 
done to produce images that more accurately reproduce the original scene and that are 
pleasing to the human eye. 

As described in connection with Fig. 1, the scanning apparatus 100 may include a 
15 calibration exposure device 107 that produces a calibration, or reference patch 350 in an 
unexposed area 352 of the photographic film 320, as illustrated in Fig. 3. This step is 
typically performed by the calibration exposure device 107; however, the reference patch 350 
may be formed before or during scene exposure. After scene exposure and reference patch 
creation, the film 320 is chemically processed, and the attenuation of radiation by the silver 
20 metal particles in the area 352 where the reference patches 350 were created is measured. 
The measured reference patch attenuation is used to calculate image processing parameter 
values that are used to digitally process the front, back and through channels collected for the 
scene image 354 to produce appropriate initial red, green and blue values. 

Thus, 'one implementation of the present invention involves the following process. 

25 After axoU of film has been exposed to light to form scene'images 354, reference patches 350 
are created on the photographic film 320 in an unexposed area of the fibn 320. As mentioned 
previously, this step is preferably done at the time of chemical development and film 
scarming. The reference patches 350 may be cither a gray scale or colored, such as red, green, 
or blue. Likewise, the reference patches 350 may consist of both gray scale and colored 

30 patches. The reference patch 350 exposures and spectral properties are accurately known by 
either design or by direct measurement. Then, the front, back, front-through, and back- 
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through signals from each of the reference patches 356:an^ jftipm each of the scene irtiage^;; :-^:^: \^:^':^ 
354 are measured.v As discussed in greater iictail belo\y,iJrfie processmg para^ 

which are used to produce Ihe initial red, green and blue values for the scene images 354 from : 
the signals corresponding to those scene images 354 arc derived from the front, back, front- 
5 through, and back-lhrough signals corresponding to the reference patches 350. Finally, the 
front, back, fronl-lhrough, and back-through channel data, for the scene images 354 are 
processed to produce appropriate initial red, green and blue values using the image processing 
parameters that were calculated from the reference patches 350. 

Next, some possible image processing functions which may be used according to the 
10 present invention to produce initial color values from the image processing parameters are 
discussed. One function that uses the reference patch data taught by the present invention is 
known as the Rcgress-to-Through-Channel ("RTC") function. Basically, for each pixel 
corresponding to each of the four charmels, the pixel's color values are adjusted such that 
gray pixels have exactly the same value in each channel. One implementation for performing 
15 Regress-lo-Through-Channel image processing is as follows. First, the front, back, and 
through (either the front-through or the back-through chaimel may be used) signals from the 
reference gray patches are read. Next, two plots are made, one being the through channel 
mean values for each gray reference patch versus the front channel mean values. The second 
plot is the through channel mean values for each gray reference patch versus the back channel 
20 mean values. Then, an equation is fit to each plot. Any equation type or algorithm could be 
used, although a cubic equation is preferred. For each pixel in the front channel for the entire 
scene image, a new front value is calculated based on the equation that was fit to the through- 
versus- front plot. Likewise, for each pixel in the back channel for the entire scene image, a 
new back value is calculated based on the equation fit to tlic through-versus-back plot. 

25 Manipulating the pixel data in this way has the effect of producing better grays than prior art 

— ** 

systems and separating non-gray pixels from gray pixels. 

A second image processing function that may make use of the reference patch data is 
a stretch function. In general, values in the front, back, and through (either the front-through 
or the back-through channel may be used) channels are adjusted such that they have the same 
30 range as an aim signal. The aim signal is defined as that set of signals that the calibration 
patches are designed to give. That is, there is an aim signal for each patch that directly 
corresponds to the exposure used to generate that patch. Specifically, the process begins by 
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i , / . y^^ ]^ signals from rcferenpe^y patchw plac^^^ J ;V • ' il? 

V i ^i^^i^ i plot, made of ti^ sum values of the gray patches yereys '1116 throiigh cHah^^^^ 

gray reference patch. Next, a best-fit equation is calculated for the plot. While a linear ^'-'^M 
equation is preferred, any best-fit equation may be used. The best-fit equation is then applied^ 
5 to every pixel in the front, back, and through channel data for the- entire scene image to give 

new pixel values in each of the channels. Use of the stretch function produces good blacks 
and whites in the scene image reproductions. 

Yet another image processing function involves calculating a color correction 
mapping based on gray and color calibration patches, and applying the color correction 

10 mapping to the entire scene image. First, all pixel values from the calibration patches and the 
entire sceiie image are converted to a suitable color space. Second, a color correction 
mapping is calculated between the mean values obtained for each calibration patch and the 
corresponding aim values for each patch. The calculation method may assume that the color 
correction mapping is linear or non-linear, and it may be implemented as a regression 

15 technique or by other methods. One example is to calculate a color correction mapping by 
applying a linear regression resulting in a 3 x 3 matrix. Third, the color correction mapping is 
applied to every pixel in the entire scene image. The result is that the scene image is a more 
accurate representation of the color in the original scene than without the color correction 
mapping applied. 



20 



It is intended that the description of the present invention provided above is but one 
embodiment for implementing the invention. Variations in the description likely to be 
conceived of by those skilled in the art still fall within the breadth and scope of the disclosure 
of the present invention. For example, although the technique of the present invention has 
been described in the context of its application to standard color fihn, another option is to use 
25 a film built specifically for this purpose. The film would require no color couplers as a color 
image never develops. While specific alternatives to steps of the invention have been 
described herein, additional alternatives not specifically disclosed but known in the art are 
intended to fall within the scope of the invention. Thus, it is understood that other 
applications of the present invention will be apparent to those skilled in the art upon the 
30 reading of the described embodiment and a consideration of the appended claims and 
drawings. 
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WE CLAIM: 



1. 



10 



15 



20 



reference patch, ihc method comprising: 

exposing the film to a calibration light source to create a reference patch; 
coating a developer solution onto the film; 



electronic reference image; 

calculating processing parameters using the electronic reference image; and 
processing the electronic image using the processing parameters. 

2. The method of Claim 1, wherein the step of scanning the coated film 
comprises electronically scanning a dye image in the coated film to produce an electronic 
image and an electronic reference image. 

3. The method of Claim 1, wherein the step of scanning the coated film 
comprises electronically scanning a latent silver image in the coated film to produce an 
electronic image and an electronic reference image. 

4. The method of Claim 1, wherein the step of scanning the coated film 
comprises electronically scanning a latent silver image and a dye image in the coated film to 
produce an electronic image and an electronic reference image. 

5. The method of Claim 1, wherein the step of calculating processing parameters 
using the electronic reference image comprises defining a color correction map using the 
electronic reference image and a standard. 

6. The method of Claim 1, wherein the reference patch comprises a gray scale 
reference patch. 

7. The method of Claim 1, wherein the step of electronically scanning the coated 
film comprises electronically scanning the coated film using infrared light to produce an 
electronic image and an electronic reference image. 



electronically scanning the coated film to produce an electronic image and an 
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8. The method of Claim 1, wherein the step of electronically scanning the cpatc^v ^^^ 
film comprises electronically scanning the coaled film using white light to produce rariv^:;! 4^^^^ 
electronic image and an electronic reference image. = ; V 

9. The method of Claim 1, wherein the step of electronically scanning the coated' 
5 film comprises electronically scanning the film using frpnt, back, front-through and back- 
through imaging. 

10. The method of Claim 9, wherein the step of calculating processing parameters 
using the electronic reference image comprises: 

plotting mean values for the electronic reference image versus front channel 
10 mean values to fomi a first plot; 

plotting through channel mean values for the electronic reference image versus 
back channel mean values to form a second plot; 

deterniining a first equation which best fits the first plot; 

determining a second equation which best fits the second plot; 
15 calculating a new data value for each pixel in the front imaging signal based 

on the first equation; and 

calculating a new data value for each pixel in the back imaging signal based on 
the second equation. 



II. The method of Claim 10 wherein the first and second equations are cubic 
20 equations. 
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12. An electronic film processing system for processing exposed urideveloped 
film, comprising: 

a calibraliori light source operable lo create a reference patch on the film; 

an applicator operable lo apply a film processing solution to the film;' 
5 at least one imaging station operable to scan the coated film and produce an electronic 

image of a scene and the reference patch; and 

a computer processor coupled to the. at least one imaging station, \yhercin the 
electronic image of the reference patch is used in calculating image processing parameters for 
correcting the electronic image of the scene. 

10 

13. The electronic film processing system of Claim 12, wherein the applicator 
comprises at least one slot coater device. 



14. The electronic film processing system of Claim 12, wherein the at least one 
15 imaging station comprises: 

a light source operable to illuminate the film; and 

a sensor system operable to detect metallic silver particles in the film, 

15. The electronic film processing system of Claim 12, wherein the at least one 
20 imaging station comprises: 

a light source operable to illuminate the film; and 

a sensor system operable to detect color dyes in the film. 



16. The electronic film processing system of Claim 12, wherein the at least one 
25 imaging station comprises: 

a first imaging station comprising: 

a first light source operable lo illuminate the film; and 
a first sensor system operable to detect metallic silver particles in the film; and 
a second imaging station comprising: 
30 a second light source operable to illuminate the film; and 

a second sensor system operable to detect color dyes in the film. 
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, providing a filnv with a latent scene image on a fi : i-'^';.; :u j:;,^--. 

creating ai least one reference patch having known spectral properties on a 
second area of the film; 
5 applying a developer solution to the film; 

developing the coaled film to form a scene image and developed reference 

patch images; 

scanning the coated film to generate signals corresponding to digital 
representations of the developed scene image and the developed patch images; 
10 calculating image processing parameters from the signals associated with the 

developed patch images; and 

processing the digital representations of the developed scene image using the 
calculated image processing parameters to produce color values for the scene image. 

18. The scene image of Claim 17, wherein the developed scene image signals and 
15 the developed patch image signals are generated through front, back, front-through and back- 
through imaging. 

19. The scene image of Claim 17 wherein generating signals corresponding to 
digital representations of the images further comprises: 

directing a first illumination source toward a first surface of said film; 
20 capturing radiation reflected from said first surface on a pixel by pixel basis; 

assigning a data value to the amount of reflected radiation from said first 
surface for each pixel to form the fi-ont imaging signal; 

- • directing a second illumination source toward a second surface of said film, 
said second surface and said first surface forming opposite sides of said film; 
25 capturing radiation reflected from said second surface of said film on a pixel 

by pixel basis; 

assigning a data value to the amount of reflected radiation from said second 
surface for each pixel to form the back imaging signal; 

capturing radiation transmitted through said film from said second 
30 illumination source on a pixel by pixel basis; 
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assigning a data value to the amount of transmitted radiation from said first 
siirface for each pixel to form the front-thrpugh imagi^^ 

capturing radiation transmitted through said film from said first illumination 
source on a pixel by pixel basis; and 
5 assigning a data value to the amount of transmitted radiation from said second 

surface for each pixel to form the back-through imaging signal. 

20. The scene image of Claim 19* wherein processing the digital representations 
further comprises: 

reading the front, back, front-through and back-through signals for reference 
10 gray patches; 

plotting through channel mean values for each gray reference patch versus 
front channel mean values to form a first plot; 

plotting through channel mean values for each gray reference patch versus 
back channel mean values to fomi a second plot; 
15 determining a first equation which best fits the first plot; 

determining a second equation which best fits the second plot; 
calculating a new data value for each pixel in the front imaging signal based 
on the first equation; and 

calculating a new data value for each pixel in the back imaging signal based on 
20 the second equation. 
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